Focused Decoding Enables 3D Anatomical Detection by Transformers

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on par with or even superior to their highly optimized CNN-based counterparts operating on 2D natural images, their success is closely coupled to access to a vast amount of training data. This, however, restricts the feasibility of employing Detection Transformers in the medical domain, as access to annotated data is typically limited. To tackle this issue and facilitate the advent of medical Detection Transformers, we propose a novel Detection Transformer for 3D anatomical structure detection, dubbed Focused Decoder. Focused Decoder leverages information from an anatomical region atlas to simultaneously deploy query anchors and restrict the cross-attention's field of view to regions of interest, which allows for a precise focus on relevant anatomical structures. We evaluate our proposed approach on two publicly available CT datasets and demonstrate that Focused Decoder not only provides strong detection results and thus alleviates the need for a vast amount of annotated data but also exhibits exceptional and highly intuitive explainability of results via attention weights. Our code is available at https://github.com/bwittmann/transoar.Comment: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2023:00

Focused Decoding Enables 3D Anatomical Detection by Transformers

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on par with or even superior to their highly optimized CNN-based counterparts operating on 2D natural images, their success is closely coupled to access to a vast amount of training data. This, however, restricts the feasibility of employing Detection Transformers in the medical domain, as access to annotated data is typically limited. To tackle this issue and facilitate the advent of medical Detection Transformers, we propose a novel Detection Transformer for 3D anatomical structure detection, dubbed Focused Decoder. Focused Decoder leverages information from an anatomical region atlas to simultaneously deploy query anchors and restrict the cross-attention's field of view to regions of interest, which allows for a precise focus on relevant anatomical structures. We evaluate our proposed approach on two publicly available CT datasets and demonstrate that Focused Decoder not only provides strong detection results and thus alleviates the need for a vast amount of annotated data but also exhibits exceptional and highly intuitive explainability of results via attention weights. Code for Focused Decoder is available in our medical Vision Transformer library this http URL

A common approach for absolute quantification of short chain CoA thioesters in prokaryotic and eukaryotic microbes

Background Thioesters of coenzyme A participate in 5% of all enzymatic reactions. In microbial cell factories, they function as building blocks for products of recognized commercial value, including natural products such as polyketides, polyunsaturated fatty acids, biofuels, and biopolymers. A core spectrum of approximately 5–10 short chain thioesters is present in many microbes, as inferred from their genomic repertoire. The relevance of these metabolites explains the high interest to trace and quantify them in microbial cells. Results Here, we describe a common workflow for extraction and absolute quantification of short chain CoA thioesters in different gram-positive and gram-negative bacteria and eukaryotic yeast, i.e. Corynebacterium glutamicum, Streptomyces albus, Pseudomonas putida, and Yarrowia lipolytica. The approach assessed intracellular CoA thioesters down to the picomolar level and exhibited high precision and reproducibility for all microbes, as shown by principal component analysis. Furthermore, it provided interesting insights into microbial CoA metabolism. A succinyl-CoA synthase defective mutant of C. glutamicum exhibited an unaffected level of succinyl-CoA that indicated a complete compensation by the L-lysine pathway to bypass the disrupted TCA cycle. Methylmalonyl-CoA, an important building block of high-value polyketides, was identified as dominant CoA thioester in the actinomycete S. albus. The microbe revealed a more than 10,000-fold difference in the abundance of intracellular CoA thioesters. A recombinant strain of S. albus, which produced different derivatives of the antituberculosis polyketide pamamycin, revealed a significant depletion of CoA thioesters of the ethylmalonyl CoA pathway, influencing product level and spectrum. Conclusions The high relevance of short chain CoA thioesters to synthetize industrial products and the interesting insights gained from the examples shown in this work, suggest analyzing these metabolites in microbial cell factories more routinely than done so far. Due to its broad application range, the developed approach appears useful to be applied this purpose. Hereby, the possibility to use one single protocol promises to facilitate automatized efforts, which rely on standardized workflows

Relationformer: A Unified Framework for Image-to-Graph Generation

A comprehensive representation of an image requires understanding objects and their mutual relationship, especially in image-to-graph generation, e.g., road network extraction, blood-vessel network extraction, or scene graph generation. Traditionally, image-to-graph generation is addressed with a two-stage approach consisting of object detection followed by a separate relation prediction, which prevents simultaneous object-relation interaction. This work proposes a unified one-stage transformer-based framework, namely Relationformer, that jointly predicts objects and their relations. We leverage direct set-based object prediction and incorporate the interaction among the objects to learn an object-relation representation jointly. In addition to existing [obj]-tokens, we propose a novel learnable token, namely [rln]-token. Together with [obj]-tokens, [rln]-token exploits local and global semantic reasoning in an image through a series of mutual associations. In combination with the pair-wise [obj]-token, the [rln]-token contributes to a computationally efficient relation prediction. We achieve state-of-the-art performance on multiple, diverse and multi-domain datasets that demonstrate our approach's effectiveness and generalizability

A phylogenetic classification of the world’s tropical forests

Knowledge about the biogeographic affinities of the world’s tropical forests helps to better understand regional differences in forest structure, diversity, composition and dynamics. Such understanding will enable anticipation of region specific responses to global environmental change. Modern phylogenies, in combination with broad coverage of species inventory data, now allow for global biogeographic analyses that take species evolutionary distance into account. Here we present the first classification of the world’s tropical forests based on their phylogenetic similarity. We identify five principal floristic regions and their floristic relationships: (1) Indo-Pacific, (2) Subtropical, (3) African, (4) American, and (5) Dry forests. Our results do not support the traditional Neo- versus Palaeo-tropical forest division, but instead separate the combined American and African forests from their Indo-Pacific counterparts. We also find indications for the existence of a global dry forest region, with representatives in America, Africa, Madagascar and India. Additionally, a northern hemisphere Subtropical forest region was identified with representatives in Asia and America, providing support for a link between Asian and American northern hemisphere forests

An estimate of the number of tropical tree species

The high species richness of tropical forests has long been recognized, yet there remains substantial uncertainty regarding the actual number of tropical tree species. Using a pantropical tree inventory database from closed canopy forests, consisting of 657,630 trees belonging to 11,371 species, we use a fitted value of Fisher’s alpha and an approximate pantropical stem total to estimate the minimum number of tropical forest tree species to fall between ∼40,000 and ∼53,000, i.e. at the high end of previous estimates. Contrary to common assumption, the Indo-Pacific region was found to be as species-rich as the Neotropics, with both regions having a minimum of ∼19,000–25,000 tree species. Continental Africa is relatively depauperate with a minimum of ∼4,500–6,000 tree species. Very few species are shared among the African, American, and the Indo-Pacific regions. We provide a methodological framework for estimating species richness in trees that may help refine species richness estimates of tree-dependent taxa

Climatic controls of decomposition drive the global biogeography of forest-tree symbioses

The identity of the dominant root-associated microbial symbionts in a forest determines the ability of trees to access limiting nutrients from atmospheric or soil pools1,2, sequester carbon3,4 and withstand the effects of climate change5,6. Characterizing the global distribution of these symbioses and identifying the factors that control this distribution are thus integral to understanding the present and future functioning of forest ecosystems. Here we generate a spatially explicit global map of the symbiotic status of forests, using a database of over 1.1 million forest inventory plots that collectively contain over 28,000 tree species. Our analyses indicate that climate variables—in particular, climatically controlled variation in the rate of decomposition—are the primary drivers of the global distribution of major symbioses. We estimate that ectomycorrhizal trees, which represent only 2% of all plant species7, constitute approximately 60% of tree stems on Earth. Ectomycorrhizal symbiosis dominates forests in which seasonally cold and dry climates inhibit decomposition, and is the predominant form of symbiosis at high latitudes and elevation. By contrast, arbuscular mycorrhizal trees dominate in aseasonal, warm tropical forests, and occur with ectomycorrhizal trees in temperate biomes in which seasonally warm-and-wet climates enhance decomposition. Continental transitions between forests dominated by ectomycorrhizal or arbuscular mycorrhizal trees occur relatively abruptly along climate-driven decomposition gradients; these transitions are probably caused by positive feedback effects between plants and microorganisms. Symbiotic nitrogen fixers—which are insensitive to climatic controls on decomposition (compared with mycorrhizal fungi)—are most abundant in arid biomes with alkaline soils and high maximum temperatures. The climatically driven global symbiosis gradient that we document provides a spatially explicit quantitative understanding of microbial symbioses at the global scale, and demonstrates the critical role of microbial mutualisms in shaping the distribution of plant species

Evenness mediates the global relationship between forest productivity and richness

1. Biodiversity is an important component of natural ecosystems, with higher species richness often correlating with an increase in ecosystem productivity. Yet, this relationship varies substantially across environments, typically becoming less pronounced at high levels of species richness. However, species richness alone cannot reflect all important properties of a community, including community evenness, which may mediate the relationship between biodiversity and productivity. If the evenness of a community correlates negatively with richness across forests globally, then a greater number of species may not always increase overall diversity and productivity of the system. Theoretical work and local empirical studies have shown that the effect of evenness on ecosystem functioning may be especially strong at high richness levels, yet the consistency of this remains untested at a global scale. 2. Here, we used a dataset of forests from across the globe, which includes composition, biomass accumulation and net primary productivity, to explore whether productivity correlates with community evenness and richness in a way that evenness appears to buffer the effect of richness. Specifically, we evaluated whether low levels of evenness in speciose communities correlate with the attenuation of the richness–productivity relationship. 3. We found that tree species richness and evenness are negatively correlated across forests globally, with highly speciose forests typically comprising a few dominant and many rare species. Furthermore, we found that the correlation between diversity and productivity changes with evenness: at low richness, uneven communities are more productive, while at high richness, even communities are more productive. 4. Synthesis. Collectively, these results demonstrate that evenness is an integral component of the relationship between biodiversity and productivity, and that the attenuating effect of richness on forest productivity might be partly explained by low evenness in speciose communities. Productivity generally increases with species richness, until reduced evenness limits the overall increases in community diversity. Our research suggests that evenness is a fundamental component of biodiversity–ecosystem function relationships, and is of critical importance for guiding conservation and sustainable ecosystem management decisions

Evenness mediates the global relationship between forest productivity and richness

1. Biodiversity is an important component of natural ecosystems, with higher species richness often correlating with an increase in ecosystem productivity. Yet, this relationship varies substantially across environments, typically becoming less pronounced at high levels of species richness. However, species richness alone cannot reflect all important properties of a community, including community evenness, which may mediate the relationship between biodiversity and productivity. If the evenness of a community correlates negatively with richness across forests globally, then a greater number of species may not always increase overall diversity and productivity of the system. Theoretical work and local empirical studies have shown that the effect of evenness on ecosystem functioning may be especially strong at high richness levels, yet the consistency of this remains untested at a global scale. 2. Here, we used a dataset of forests from across the globe, which includes composition, biomass accumulation and net primary productivity, to explore whether productivity correlates with community evenness and richness in a way that evenness appears to buffer the effect of richness. Specifically, we evaluated whether low levels of evenness in speciose communities correlate with the attenuation of the richness–productivity relationship. 3. We found that tree species richness and evenness are negatively correlated across forests globally, with highly speciose forests typically comprising a few dominant and many rare species. Furthermore, we found that the correlation between diversity and productivity changes with evenness: at low richness, uneven communities are more productive, while at high richness, even communities are more productive. 4. Synthesis. Collectively, these results demonstrate that evenness is an integral component of the relationship between biodiversity and productivity, and that the attenuating effect of richness on forest productivity might be partly explained by low evenness in speciose communities. Productivity generally increases with species richness, until reduced evenness limits the overall increases in community diversity. Our research suggests that evenness is a fundamental component of biodiversity–ecosystem function relationships, and is of critical importance for guiding conservation and sustainable ecosystem management decisions